Context-dependent partitioning of motor learning in bimanual movements.

Human subjects easily adapt to single dynamic or visuomotor perturbations. In contrast, when two opposing dynamic or visuomotor perturbations are presented sequentially, interference is often observed. We examined the effect of bimanual movement context on interference between opposing perturbations using pairs of contexts, in which the relative direction of movement between the two arms was different across the pair. When each perturbation direction was associated with a different bimanual context, such as movement of the arms in the same direction versus movement in the opposite direction, interference was dramatically reduced. This occurred over a short period of training and was seen for both dynamic and visuomotor perturbations, suggesting a partitioning of motor learning for the different bimanual contexts. Further support for this was found in a series of transfer experiments. Having learned a single dynamic or visuomotor perturbation in one bimanual context, subjects showed incomplete transfer of this learning when the context changed, even though the perturbation remained the same. In addition, we examined a bimanual context in which one arm was moved passively and show that the reduction in interference requires active movement. The sensory consequences of movement are thus insufficient to allow opposing perturbations to be co-represented. Our results suggest different bimanual movement contexts engage at least partially separate representations of dynamics and kinematics in the motor system

Composition and decomposition in bimanual dynamic learning.

Our ability to skillfully manipulate an object often involves the motor system learning to compensate for the dynamics of the object. When the two arms learn to manipulate a single object they can act cooperatively, whereas when they manipulate separate objects they control each object independently. We examined how learning transfers between these two bimanual contexts by applying force fields to the arms. In a coupled context, a single dynamic is shared between the arms, and in an uncoupled context separate dynamics are experienced independently by each arm. In a composition experiment, we found that when subjects had learned uncoupled force fields they were able to transfer to a coupled field that was the sum of the two fields. However, the contribution of each arm repartitioned over time so that, when they returned to the uncoupled fields, the error initially increased but rapidly reverted to the previous level. In a decomposition experiment, after subjects learned a coupled field, their error increased when exposed to uncoupled fields that were orthogonal components of the coupled field. However, when the coupled field was reintroduced, subjects rapidly readapted. These results suggest that the representations of dynamics for uncoupled and coupled contexts are partially independent. We found additional support for this hypothesis by showing significant learning of opposing curl fields when the context, coupled versus uncoupled, was alternated with the curl field direction. These results suggest that the motor system is able to use partially separate representations for dynamics of the two arms acting on a single object and two arms acting on separate objects

Statistics of Natural Movements Are Reflected in Motor Errors

Humans use their arms to engage in a wide variety of motor tasks during everyday life. However, little is known about the statistics of these natural arm movements. Studies of the sensory system have shown that the statistics of sensory inputs are key to determining sensory processing. We hypothesized that the statistics of natural everyday movements may, in a similar way, influence motor performance as measured in laboratory-based tasks. We developed a portable motion-tracking system that could be worn by subjects as they went about their daily routine outside of a laboratory setting. We found that the well-documented symmetry bias is reflected in the relative incidence of movements made during everyday tasks. Specifically, symmetric and antisymmetric movements are predominant at low frequencies, whereas only symmetric movements are predominant at high frequencies. Moreover, the statistics of natural movements, that is, their relative incidence, correlated with subjects' performance on a laboratory-based phase-tracking task. These results provide a link between natural movement statistics and motor performance and confirm that the symmetry bias documented in laboratory studies is a natural feature of human movement. </jats:p

Gone in 0.6 seconds: the encoding of motor memories depends on recent sensorimotor states.

Real-world tasks often require movements that depend on a previous action or on changes in the state of the world. Here we investigate whether motor memories encode the current action in a manner that depends on previous sensorimotor states. Human subjects performed trials in which they made movements in a randomly selected clockwise or counterclockwise velocity-dependent curl force field. Movements during this adaptation phase were preceded by a contextual phase that determined which of the two fields would be experienced on any given trial. As expected from previous research, when static visual cues were presented in the contextual phase, strong interference (resulting in an inability to learn either field) was observed. In contrast, when the contextual phase involved subjects making a movement that was continuous with the adaptation-phase movement, a substantial reduction in interference was seen. As the time between the contextual and adaptation movement increased, so did the interference, reaching a level similar to that seen for static visual cues for delays >600 ms. This contextual effect generalized to purely visual motion, active movement without vision, passive movement, and isometric force generation. Our results show that sensorimotor states that differ in their recent temporal history can engage distinct representations in motor memory, but this effect decays progressively over time and is abolished by ∼600 ms. This suggests that motor memories are encoded not simply as a mapping from current state to motor command but are encoded in terms of the recent history of sensorimotor states

The visual geometry of a tool modulates generalization during adaptation.

Knowledge about a tool's dynamics can be acquired from the visual configuration of the tool and through physical interaction. Here, we examine how visual information affects the generalization of dynamic learning during tool use. Subjects rotated a virtual hammer-like object while we varied the object dynamics separately for two rotational directions. This allowed us to quantify the coupling of adaptation between the directions, that is, how adaptation transferred from one direction to the other. Two groups experienced the same dynamics of the object. For one group, the object's visual configuration was displayed, while for the other, the visual display was uninformative as to the dynamics. We fit a range of context-dependent state-space models to the data, comparing different forms of coupling. We found that when the object's visual configuration was explicitly provided, there was substantial coupling, such that 31% of learning in one direction transferred to the other. In contrast, when the visual configuration was ambiguous, despite experiencing the same dynamics, the coupling was reduced to 12%. Our results suggest that generalization of dynamic learning of a tool relies, not only on its dynamic behaviour, but also on the visual configuration with which the dynamics is associated

Enhanced crosslimb transfer of force-field learning for dynamics that are identical in extrinsic and joint-based coordinates for both limbs.

Humans are able to adapt their motor commands to make accurate movements in novel sensorimotor environments, such as when wielding tools that alter limb dynamics. However, it is unclear to what extent sensorimotor representations, obtained through experience with one limb, are available to the opposite, untrained limb and in which form they are available. Here, we compared crosslimb transfer of force-field compensation after participants adapted to a velocity-dependent curl field, oriented either in the sagittal or the transverse plane. Due to the mirror symmetry of the limbs, the force field had identical effects for both limbs in joint and extrinsic coordinates in the sagittal plane but conflicting joint-based effects in the transverse plane. The degree of force-field compensation exhibited by the opposite arm in probe trials immediately after initial learning was significantly greater after sagittal (26 ± 5%) than transverse plane adaptation (9 ± 4%; P < 0.001), irrespective of whether participants learned initially with the left or the right arm or via abrupt or gradual exposure to the force field. Thus transfer was impaired when the orientation of imposed dynamics conflicted in intrinsic coordinates for the two limbs. The data reveal that neural representations of novel dynamics are only partially available to the opposite limb, since transfer is incomplete even when force-field perturbation is spatially compatible for the two limbs, according to both intrinsic and extrinsic coordinates.Support for this work was provided by the Australian Research Council (Grant DP1093193), Trinity College, Wellcome Trust, Human Frontier Science Program, and Royal Society Noreen Murray Professorship in Neurobiology (to D. M. Wolpert).This is the final version of the article. It first appeared from the American Physiological Society via http://dx.doi.org/10.1152/jn.00485.201

Unimodal statistical learning produces multimodal object-like representations.

The concept of objects is fundamental to cognition and is defined by a consistent set of sensory properties and physical affordances. Although it is unknown how the abstract concept of an object emerges, most accounts assume that visual or haptic boundaries are crucial in this process. Here, we tested an alternative hypothesis that boundaries are not essential but simply reflect a more fundamental principle: consistent visual or haptic statistical properties. Using a novel visuo-haptic statistical learning paradigm, we familiarised participants with objects defined solely by across-scene statistics provided either visually or through physical interactions. We then tested them on both a visual familiarity and a haptic pulling task, thus measuring both within-modality learning and across-modality generalisation. Participants showed strong within-modality learning and 'zero-shot' across-modality generalisation which were highly correlated. Our results demonstrate that humans can segment scenes into objects, without any explicit boundary cues, using purely statistical information.European Research Council (Consolidator Grant ERC-2016-COG/726090) Máté Lengyel Royal Society (Noreen Murray Professorship in Neurobiology RP120142) Daniel M Wolpert Seventh Framework Programme (Marie Curie CIG 618918) József Fiser Wellcome Trust (New Investigator Award 095621/Z/11/Z) Máté Lengyel National Institutes of Health (NIH R21 HD088731) József Fiser Wellcome Trust (Senior Investigator Award 097803/Z/11/Z) Daniel M Wolper

A Single-Rate Context-Dependent Learning Process Underlies Rapid Adaptation to Familiar Object Dynamics

Motor learning has been extensively studied using dynamic (force-field) perturbations. These induce movement errors that result in adaptive changes to the motor commands. Several state-space models have been developed to explain how trial-by-trial errors drive the progressive adaptation observed in such studies. These models have been applied to adaptation involving novel dynamics, which typically occurs over tens to hundreds of trials, and which appears to be mediated by a dual-rate adaptation process. In contrast, when manipulating objects with familiar dynamics, subjects adapt rapidly within a few trials. Here, we apply state-space models to familiar dynamics, asking whether adaptation is mediated by a single-rate or dual-rate process. Previously, we reported a task in which subjects rotate an object with known dynamics. By presenting the object at different visual orientations, adaptation was shown to be context-specific, with limited generalization to novel orientations. Here we show that a multiple-context state-space model, with a generalization function tuned to visual object orientation, can reproduce the time-course of adaptation and de-adaptation as well as the observed context-dependent behavior. In contrast to the dual-rate process associated with novel dynamics, we show that a single-rate process mediates adaptation to familiar object dynamics. The model predicts that during exposure to the object across multiple orientations, there will be a degree of independence for adaptation and de-adaptation within each context, and that the states associated with all contexts will slowly de-adapt during exposure in one particular context. We confirm these predictions in two new experiments. Results of the current study thus highlight similarities and differences in the processes engaged during exposure to novel versus familiar dynamics. In both cases, adaptation is mediated by multiple context-specific representations. In the case of familiar object dynamics, however, the representations can be engaged based on visual context, and are updated by a single-rate process

Postural instability in an immersive Virtual Reality adapts with repetition and includes directional and gender specific effects

The ability to handle sensory conflicts and use the most appropriate sensory information is vital for successful recovery of human postural control after injury. The objective was to determine if virtual reality (VR) could provide a vehicle for sensory training, and determine the temporal and spatial nature of such adaptive changes. Twenty healthy subjects participated in the study (10 females). The subjects watched a 90-second VR simulation of railroad (rollercoaster) motion in mountainous terrain during five repeated simulations, while standing on a force platform that recorded their stability. The immediate response to watching the VR movie was an increased level of postural instability. Repeatedly watching the same VR movie significantly reduced both the anteroposterior (62%, p < 0.001) and lateral (47%, p = 0.001) energy used. However, females adapted more slowly to the VR stimuli as reflected by higher use of total (p = 0.007), low frequency (p = 0.027) and high frequency (p = 0.026) energy. Healthy subjects can significantly adapt to a multidirectional, provocative, visual environment after 4–5 repeated sessions of VR. Consequently, VR technology might be an effective tool for rehabilitation involving visual desensitisation. However, some females may require more training sessions to achieve effects with VR

Examining ecological validity in social interaction: problems of visual fidelity, gaze, and social potential

Social interaction is an essential part of the human experience, and much work has been done to study it. However, several common approaches to examining social interactions in psychological research may inadvertently either unnaturally constrain the observed behaviour by causing it to deviate from naturalistic performance, or introduce unwanted sources of variance. In particular, these sources are the differences between naturalistic and experimental behaviour that occur from changes in visual fidelity (quality of the observed stimuli), gaze (whether it is controlled for in the stimuli), and social potential (potential for the stimuli to provide actual interaction). We expand on these possible sources of extraneous variance and why they may be important. We review the ways in which experimenters have developed novel designs to remove these sources of extraneous variance. New experimental designs using a ‘two-person’ approach are argued to be one of the most effective ways to develop more ecologically valid measures of social interaction, and we suggest that future work on social interaction should use these designs wherever possible